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Abstract: 

Stability  issues  in  a  connectionless,  one  hop  queueing  system  featuring  servers  with  over¬ 
lapping  service  regions  (e.g.  a  Mode  Select  (Mode  S)  Radar  communications  network  or 
part  of  an  Aeronautical  Telecommunications  Network  (ATN)  network)  are  considered,  and 
a  stabilizing  policy  is  determined  in  closed-loop  form.  The  cases  of  queues  at  the  sources 
(aircraft)  and  queues  at  the  servers  (base  stations)  are  considered  separately.  Stabilizabil- 
ity  of  the  system  with  exponential  service  times  and  Poisson  arrival  rates  is  equivalent  to 
the  solvability  of  a  linear  program  and  if  the  system  is  stabilizable,  a  stabilizing  open  loop 
routing  policy  can  be  expressed  in  terms  of  the  coefficients  of  the  solution  to  the  linear 
program.  We  solve  the  linear  program  for  the  case  of  a  single  class  of  packets. 

Introduction: 

Many  queuing  problems  in  the  literature  have  addressed  the  problem  of  routing  mes¬ 
sages  from  a  single  source  to  multiple  servers  or  serving  multiple  queues  with  a  single 
server.  This  simple  1  :  n  or  n  :  1  topology  will  not  hold  in  all  one-hop  queueing  networks. 

The  topology  we  analyze  is  based  on  the  Mode  S  system  for  the  air/ ground  segment  of 
communication  between  aircraft  and  air  traffic  control.  Our  system  consists  of  multiple 
servers  with  overlapping  service  areas.  This  topology  also  is  appropriate  for  a  connection¬ 
less  satellite  or  cellular  network,  or  a  network  in  which  load  sharing  is  employed  as  in  the 
Mobile  IP  standard. 

In  the  Mode  Select  (Mode  S)  radar  beacon  system  [2],  Mode  S  base  stations  com¬ 
municate  with  aircraft  by  “interrogation”.  In  an  interrogation,  the  base  station  sends 
packets  to  the  aircraft.  Mode  S  regions  overlap  by  necessity,  and  the  overlap  is  largest  at 
high  altitudes.  For  Mode  S  stations  under  different  controllers,  there  is  a  hard  boundary 
between  their  respective  areas  of  responsibility:  aircraft  on  one  side  of  the  region  are 
connected  to  one  base  station,  and  aircraft  on  the  other  side  are  connected  to  the  other. 
For  two  base  stations  under  the  same  controller,  control  is  decided  on  a  per-aircraft  basis 
for  aircraft  in  the  overlap  of  their  coverage  regions.  This  decision  is  made  by  the  central 
ground  controller,  and  uses  dynamic  information.  The  location  of  the  aircraft  is  never 
in  question,  nor  must  the  location  be  measured  by  signal  strength;  the  Mode  S  stations 


1This  paper  is  based  on  [14],  written  by  the  same  authors 


are  also  responsible  for  radar  tracking  of  the  aircraft,  and  the  central  ground  station  has 
a  composite  picture  of  all  the  aircraft  in  the  area.  The  Mode  S  radar  beacon  system  is 
only  a  part  of  the  Aeronautical  Telecommunications  Network  (ATN),  which  is  a  network 
of  networks  comprising  Mode  S,  Satellite,  and  VHF  Data  Link  for  the  air/ground  link. 
The  results  in  this  paper  apply  a  fortiori  to  the  air/ground  link  of  the  ATN. 

In  this  paper,  we  use  the  equivalence  of  stabilizability  (defined  below)  of  queueing- 
problems  involving  routing  decisions  to  the  existence  of  a  solution  to  a  linear  program. 
The  linear  program  can  be  explicitly  solved  for  the  case  of  a  single  class  of  packets,  and 
we  determine  a  stabilizing  open  loop  control  thereby. 

Linear  programming  techniques  have  been  used  ([3],  [4],  [8],  [9],  [10],  [12],  and  [13]) 
to  analyze  stability  of  queueing  networks.  In  [3],  [4],  [10],  and  [12],  linear  programming 
techniques  were  used  to  determine  stabilizability  of  scheduling  problems  on  reentrant  lines. 
In  [8],  [9],  and  [13],  linear  programming  techniques  were  applied  to  routing  problems. 

Kumar,  Down,  and  Mevn  have  explored  the  use  of  quadratic  and  piecewise  linear 
cost  functions  in  linear  programs  to  demonstrate  stability  of  a  queueing  network  under 
a  specific  policy  and  also  under  a  class  of  policies.  The  method  to  determine  stability 
of  a  policy  is  to  construct  a  Lyapunov  function  using  quadratic  or  piecewise  linear  cost 
functions  and  then  to  use  Foster’s  criterion.  LPs  are  constructed,  which,  if  solved,  would 
prove  stabilizability.  In  [4],  Kumar  showed  the  equivalence  of  the  existence  of  a  solution 
to  a  linear  program  (LP)  to  the  stabilizability  of  a  scheduling  problem.  In  [12],  Kumar 
further  found  linear  programs  which,  if  solvable,  implied  the  stability  of  all  non-idling 
policies  for  some  scheduling  problems.  In  [10],  Down  and  Mevn  analyzed  stability  of 
reentrant  line  queueing  systems.  In  [3],  Kumar  and  Meyn  used  linear  and  nonlinear 
programs  to  deduce  an  appropriate  quadratic  Lyapunov  function. 

In  this  paper,  we  tie  the  stabilizability  of  a  routing  problem  to  the  solvability  of  a  linear 
program. 

In  [9],  Tassiulas  and  Ephremides  found  an  equivalence  between  stabilizability  of  a 
general  queueing  network  and  the  solvability  of  a  linear  program  in  constraint  form. 
Tassiulas  and  Ephremides  also  examine  a  multi-hop  queueing  system  in  [8],  deriving 
stabilizability  conditions  and  demonstrating  a  closed-  loop  stabilizing  policy  that  is  a 
special  case  of  the  policy  constructed  in  [9].  Also,  in  [13],  Tassiulas  generalizes  the  results 
to  systems  with  a  time-varying  topology.  Our  stabilizability  result  is  a  special  case  of 
the  multi-hop  result  in  [9],  but  here  we  solve  the  linear  program  explicitly  in  the  case  of 
a  single  class  of  packets,  yielding  a  stabilizing  open  loop  policy.  Similarly,  if  the  linear 
program  of  [9]  is  solved,  a  stabilizing  policy  for  the  more  general,  multi-hop  network  is 
given  in  terms  of  the  solution  to  the  linear  program. 

We  are  concerned  with  controlled  Markov  chains  describing  queueing  systems.  We 
define  a  Markov  chain  consisting  of  the  vector  of  queue  lengths  in  a  queueing  network 
to  be  stable  if  it  converges  to  an  ergodic  distribution  with  finite  average  queue  length  in 
each  queue,  and  we  define  a  controlled  queueing  network  or  system  to  be  stabilizable  if 
there  exists  a  stationary  control  policy  that  induces  a  stable  Markov  chain. 

The  contributions  of  this  paper  are  the  application  of  linear  programming  techniques 


to  a  routing  problem  and  the  determination  of  open  loop  stabilizing  policies  for  that 
problem  by  solving  the  linear  program  in  the  case  of  a  single  class  of  packets.  Open  loop 
control  policies  are  of  particular  interest  because  in  a  real  network,  it  is  often  difficult  for 
a  controller  at  one  node  to  obtain  queue  length  information  at  other  nodes. 

We  make  use  of  an  equivalence  between  discrete  time  and  continuous  time  systems 
called  “uniformization” .  This  equivalence  was  discussed  by  Serfozo  in  [5]  (see  also  ref¬ 
erences  therein),  and  appears  in  the  context  of  a  discounted  optimal  cost  problem  in  [7] 
(page  283). 

The  paper  is  organized  as  follows:  In  Section  1,  the  problem  is  described  and  open  loop 
stabilizability  results  are  presented  which  show  that  the  solvability  of  a  linear  program 
is  a  necessary  and  sufficient  condition  for  stabilizability  of  the  system,  and  a  stabilizing 
open  loop  policy  is  determined  in  terms  of  the  coefficients  of  the  solution  to  the  linear 
program.  Sections  2  and  3  contain  the  main  results  of  this  paper:  explicit  solutions  of  the 
linear  program  for  two  cases.  The  proofs  of  the  results  in  Sections  2  and  3  are  presented 
in  the  appendices.  The  proofs  of  Propositions  1  and  2  in  Section  [1]  are  omitted;  they 
can  be  deduced  from  the  general  stability  result  in  [9]. 

Section  1:  The  general  shared-queues  problem 

Let  there  be  n  servers  and  m  =  C  ■  (2n  —  1)  arrival  processes.  Label  the  servers 
{.S'|.  ...,5,, }.  Each  arrival  process  is  dedicated  to  a  subset  L  C  {l,...,n}  of  the  servers. 
Also,  each  arrival  process  contains  only  class  j  packets,  where  j  =  1. ....  C.  Since  there  are 
2n  — 1  nonempty  subsets  of  {1, ...,  n]  and  C  classes  of  packets,  there  are  rri  arrival  processes. 
Label  the  arrival  processes  { ,4}  } .  1  We  will  examine  two  systems  with  this  configuration 
of  servers  and  arrival  processes:  the  controlled  arrival  process  problem  (Figure  0.2)  and 
the  controlled  service  process  problem  (Figure  0.1).  (Note:  the  figures  depict  the  problems 
for  the  simple  case  of  2  servers  and  1  class  of  packets.)  In  the  controlled  arrival  process 
problem,  there  are  n  queues,  1  dedicated  to  each  server.  Label  these  queues  {qi, ...,  qn}. 
At  the  time  a  packet  arrives  in  arrival  process  A],  the  controller  must  route  it  to  a  queue 
qi\  i  G  L.  In  the  controlled  service  process  problem,  there  are  m  queues,  one  for  each 
arrival  process.  Label  the  queue  to  which  packets  from  arrival  process  AJL  are  routed  q] . 
In  this  setup,  the  servers  must  select  a  nonempty  queue  to  serve  whenever  they  are  idle. 
Label  the  queue  lengths  re*,  where  i  G  {1,  ...,n}  in  the  controlled  arrival  process  problem 
and  L  C  {1  ,  ...,n},  j  G  {1,  ...,£7}  in  the  controlled  service  process  problem.  A  queue 
can  be  served  by  any  of  the  servers  which  share  it  (packet  class  of  a  queue  does  not  affect 
which  servers  may  serve  the  queue)in  the  controlled  service  process  problem,  and  only 
by  its  server  in  the  controlled  arrival  process  problem.  In  the  controlled  arrival  process 
problem,  packets  in  each  of  the  n  dedicated  queues  are  served  on  a  FIFO  basis.  In  the 
controlled  service  process  problem,  if  k  packets  are  in  a  shared  queue,  no  more  than  k 
servers  may  serve  it  at  one  time.  Let  the  set  of  queues  be  called  Q  and  call  the  set  of  queue 
lengths  X.  Each  server  has  a  constant  service  rate  //.,  and  each  packet  contains  an  amount 

1  Theorems  1  and  2  concern  systems  with  a  single  class  of  packets,  so  we  will  drop  the  ‘j’  from  the 
notation  in  those  sections. 


of  work  which  is  i.i.d.  exponentially  distributed  with  parameter  1,  and  arrival  process  A3L 
undergoes  Poisson  arrivals  at  rate  A} .  The  arrival  times  and  the  work  initially  contained 
in  the  packets  are  all  mutually  independent.  Also,  preemption  is  not  permitted:  once 
a  server  begins  serving  a  packet,  it  must  complete  service  on  that  packet  before  serving 
another  packet. 

Remark:  While  the  controlled  arrival  process  problem  is  a  routing  problem,  the  con¬ 
trolled  service  process  problem  contains  elements  of  both  routing  and  scheduling  since 
the  controller  must  decide  not  only  which  queue  to  serve  with  an  idle  server,  but  the 
order  in  which  to  serve  the  queues. 

Remark:  The  model  of  constant  service  rates  and  exponential  work  contained  in  a  packet 
is  equivalent  in  distribution  to  a  model  with  exponential  service  times. 

The  controlled  service  process  problem 

The  system  introduced  in  [1]  can  be  transformed  into  the  controlled  service  process 
problem  with  one  class  of  packets.  In  [1],  a  necessary  and  sufficient  condition  for  stabi- 
lizability  of  the  single-class  ((7  =  1)  system  was  found  and  a  closed-loop  policy,  “serve 
the  shortest  queue”  was  demonstrated  to  stabilize  the  system  when  it  is  stabilizable.  The 
stabilizability  condition  for  C  =  1  is: 

V/xr  {1 . >  £  A/  (1.1) 

/'•  K  LCK 

The  intuition  behind  (1.1)  is  that  for  every  set  of  servers  ( { 5.,;  i  G  it}),  the  total  service 
rate  of  the  set  is  greater  than  the  rate  of  work  arriving  that  must  be  served  by  a  server 
from  that  set. 

We  now  examine  the  stability  of  such  systems  under  multiple  classes  of  arrivals.  Sup¬ 
pose  that  the  shared  queue  qL  undergoes  Poisson  arrrivals  of  C  different  classes,  with  the 
arrival  rate  of  class  Cj  packets  equal  to  A]  .  Suppose  that  the  service  rate  of  server  S)  now 
depends  on  both  the  queue  and  the  class  of  packet  being  served,  such  that  the  service 
time  for  server  Si  serving  a  class  Cj  packet  in  queue  <u,  is  exponential  with  parameter  ///' / . 
Also,  consider  a  packet  in  service  as  not  being  in  queue.  The  question  is:  Under  what 
conditions  (parameter  sets)  is  this  system  stabilizable?  (We  do  not  allow  preemption  of 
packets  in  service.) 

In  an  open  loop  policy,  it  is  possible  for  a  server  to  elect  to  serve  a  queue  which  is 
empty.  When  that  happens,  we  say  that  the  server  is  serving  a  “null”  packet,  and  the 
latency  time  for  the  server  to  complete  service  of  the  null  packet  has  the  same  distribution 
as  if  it  were  serving  a  real  packet. 

We  claim  that  the  system  is  open  loop  stabilizable  iff  it  is  stabilizable,  and  we  define  a 
set  of  open  loop  Bernoulli  service  allocations  as  follows:  When  server  Si  completes  service 
on  a  packet  (or  a  null  packet  if  it  was  serving  a  class  of  packet  in  a  queue  containing 
no  packets  of  that  class),  then  it  selects  a  class  j  packet  from  queue  ql  with  probability 


pi'1' .  If  queue  L  contains  a  packet  of  class  j,  then  the  packet  is  removed  immediately  from 
queue  and  processed  in  time  distributed  exponentially  with  parameter  /ij’1' .  If  there  is  no 
such  packet  in  queue,  server  S'*  is  idle  for  the  same  period  of  time. 


Proposition  1: 

The  system  with  controlled  service  process  is  stabilizable  if  and  only  if  the  following  linear 
program  has  a  solution  with  9  <  0.  Furthermore,  if  0  <  0,  then  the  system  is  stabilized 
by  the  set  of  open  loop  Bernoulli  service  allocations 


piL  = 


j,L 

Pi 


hL  , 


>-/  ! . C:l  iZi  ‘  /' 


LP:  min  9  such  that: 


z\'L  >  0;  /  =  1, ...,  n;  j  =  3  i 

zl,L  =  l;i  = 

3- 1 . C;  L3i 

K  -Y.PiL4l  <»-,]  =  1 . C;lc 

i£L 

The  solution  to  the  LP  is  { 9 ,  {zj,L}}. 

Proof: 

The  proof  is  omitted  as  this  proposition  can  be  shown  to  be  a  special  case  of  the  theorem 
proved  by  Tassiulas  and  Ephremides  in  [9]. 

The  intuition  behind  the  LP  is  as  follows:  z{'L  is  the  fraction  of  the  time  that  server  Si 
spends  serving  a  class  j  packet  in  queue  qL  in  the  limit  (the  ergodic  distribution).  The 
first  constraint  ensures  that  each  server  is  not  utilized  more  than  all  of  the  time,  while 
the  second  constraint  ensures  (if  9  <  0)  that  the  arrival  rate  of  class  j  packets  to  queue 
qL  is  less  than  the  total  ergodic  service  rate  (the  product  of  fraction  of  time  spent  and 
exponential  service  time  parameter)  applied  to  class  j  packets  in  queue  qL  from  all  servers. 
The  binomial  splitting  probabilities  are  found  by  normalizing  the  fraction  of  time  spent 
( z )  by  the  exponential  service  time  parameter  (n). 

The  controlled  arrival  process  problem 

It  can  be  shown  using  the  general  stabilizability  result  from  [8]  that  the  condition  for 
stabilizability  of  the  controlled  arrival  process  problem  with  one  class  of  packets  is  given 
by  (1.1).  Thus  it  is  the  same  as  the  stabilizability  condition  for  the  controlled  service 
process  problem  with  a  single  class  of  packets. 


The  simplicity  of  the  stability  condition  for  the  case  of  a  single  class  of  packets  indicates 
that  a  simple  solution  may  exist  for  the  linear  program  in  that  case.  In  the  proofs  of 
Theorems  1  and  2,  the  linear  programs  of  Propositions  1  and  2  are  solved  iteratively  by 
repeatedly  reducing  the  dimensionality  of  the  system  until  it  consists  of  a  set  of  n  stable 
M/M/1  queues. 

In  the  multi-class  case,  the  stability  condition  must  be  different  for  the  controlled  arrival 
process  problem  and  the  controlled  service  problem  since  the  parameters  are  different. 
Specifically,  in  the  controlled  service  process  problem,  the  service  rate  ///' /  depends  on 
three  parameters,  whereas  in  the  controlled  arrival  process  problem,  the  service  rate  pi 
depends  on  only  two  parameters.  But  as  remarked  after  Proposition  2,  when  /if1  is 
independent  of  L,  the  stability  conditions  are  the  same. 

Define  the  set  of  open  loop  Bernoulli  routing  probabilities  {pfL}  as  follows:  When 
a  packet  of  class  j  arrives  in  arrival  process  AL%  we  assign  it  to  queue  qp  i  G  L  with 
probability  pj'L . 

Proposition  2: 

The  system  with  controlled  arrival  process  is  stabilizable  if  and  only  if  the  following  linear 
program  has  a  solution  with  9  <  0.  Furthermore,  if  0  <  o,  then  the  system  is  stabilized 
by  the  set  of  open  loop  Bernoulli  routing  probabilities 

LP:  min#  such  that: 

Pi'L  >  0;i  =  1  =  1,  •••,  C;  L  3  i 

T,PiL  =  c  {■>  •••;"}•./  =  1 . ^ 

ieL 

£- iMPfM<1  +  e.  i  =  i,,..,n 

j=l  l<i 

The  solution  to  the  LP  is  {#,  {p/,L  }  j . 

Proof: 

The  proof  is  omitted:  this  proposition  is  a  special  case  of  a  theorem  proved  by  Tassiulas 
and  Ephremides  in  [9]. 

The  intuition  behind  the  LP  is  as  follows:  pj,r‘  is  the  fraction  of  packets  from  arrival 
process  AJL  that  are  routed  to  server  S'*.  The  first  constraint  ensures  that  the  splitting 
probabilities  of  packets  in  arrival  stream  AJL  sum  to  1,  while  the  second  constraint  ensures 

that  server  S/  s  utilization  — Ll,eL,  1 — L)  iess  than  l+#<lif#<0. 

Remark:  This  LP  is  solvable  with  9  <  0  iff  the  LP  of  Proposition  1  is  solvable  with 
9  <  0  for  p,f 1  =  pi  ML  3  i,  i.e.  the  controlled  arrival  process  problem  and  the  controlled 


service  process  problem  are  stabilizable  under  the  same  parameter  sets  if  the  service 
time  distribution  in  the  controlled  service  process  problem  is  independent  of  L.  the  queue 
served,  and  is  identical  to  the  service  time  in  the  controlled  arrival  process  problem  (where 
there  is  only  one  queue  accessible  to  each  server). 


Section  2:  Open-loop  policies  for  the  controlled  arrival  process  problem  with 
a  single  class  of  packets 

The  stability  result  in  [8]  implies  the  stability  of  the  “route  to  the  shortest  queue” 
policy  for  the  case  of  a  single  class  of  packets  (C  =  1)  when  the  system  is  stabilizable. 
An  open  loop  policy  that  stabilizes  the  system  can  be  determined  by  applying  the  flow 
rates  of  the  stationary  distribution  induced  by  any  stabilizing  policy.  (A  flow  rate  of  a 
stationary  distribution  is  the  expected  fraction  of  the  time  an  arrival  to  a  given  arrival 
process  is  routed  to  a  given  queue.)  The  intuition  behind  this  is  that,  since  the  system  is 
ergodic  and  irreducible  under  the  “route  to  the  shortest  queue”  policy,  the  limit  as  t  goes 
to  infinity  of  the  rate  at  which  any  given  arrival  process  routes  its  packets  to  each  of  the 
queues  to  which  it  is  connected  exists.  We  know  that  the  sum  of  the  rates  at  which  each 
arrival  process  routes  its  packets  to  a  queue  must  be  less  than  the  service  rate  of  that 
queue  because  the  system  is  stable  under  the  “route  to  the  shortest  queue”  policy. 

Therefore,  if  we  use  open  loop  Bernoulli  routing  at  the  arrival  processes,  splitting  at 
the  rate  given  by  this  limit,  then  we  will  obtain  stability  as  the  arrival  rate  of  packets 
to  each  queue  will  be  less  than  the  service  rate.  The  problem  with  this  approach  is 
that  computation  of  these  rates  requires  knowledge  of  the  limiting  distribution.  However, 
we  may  construct  a  stable  open  loop  Bernoulli  routing  policy  given  knowledge  only  of 
the  arrival  and  service  rates  by  using  the  following  algorithm,  as  shown  in  the  proof  of 
Theorem  1. 

Algorithm  1 

GIVEN:  The  arrival  rates  {\l\L  C.  {l,...,n}}  and  the  service  rates  {pi\i  G  {l,...,n}} 

CONSTRUCT:  a  stabilizing  set  of  Bernoulli  routing  probabilities  {pf  \i  G  L  C  {1, ...,  ?r}} 

Do(j=n,n-l,...,2) 

ML  C  {1,  ...,n}  such  that  \L\  =  j 

Select  B,  D  C  L  such  that  B  n  D  =  0  and  B  U  D  =  L 

Select  two  numbers1  b  and  d  such  that  b  +  d  =  Xl  and  the  system  with  the  following 
1The  constraints  on  b  and  d  are  given  in  terms  of  '!> K ,  defined  as  follows: 

*K=  E  E  i2-1) 

s,esK  aL£Ak 

5,a  is  the  “slack”  available  between  service  and  arrival  rates  for  subset  K ,  i.e.  between  the  servers 
SK  =  {V;  i  G  K}  and  the  arrival  processes  AK  =  { Al\L  C  K}.  The  system  is  stabilizable  iff  'T' K  >  0 
V/G. 


modified  arrival  rates  is  still  stable: 


XL  =  0;  XB  is  increased  by  b;  XD  is  increased  by  d;  all  other  arrival  rates  unchanged. 

Then  modify  the  system  and  define  the  Bernoulli  routing  probabilities  {pf\i  €  L }  as 
follows: 


I>'i  =  T-P ?  +  T-P'i' 


Then  set  p\  =  1  Vi  and  the  recursion  is  complete. 

Theorem  1 

The  queuing  system  of  the  ‘controlled  arrival  process  problem’  with  one  class  of  packets 
is  stabilizable  iff  (1.1)  holds. 

Furthermore,  if  the  system  is  stabilizable,  there  exists  an  open  loop  stabilizing  policy 
which  can  be  computed  explicitly  through  the  recursive  procedure  defined  in  Algorithm 
1. 

Proof:  see  Appendix  1 

Example  1 

Now  let  us  solve  an  example  problem  (i.e.  recursively  determine  the  open  loop  Bernoulli 
routing  probabilities.)  Consider  the  arrival  processs  problem  with  three  servers  such  that 
Pi  =  1 ;  t  =  1,  2,  3  and  where  the  arrival  rates  for  the  seven  arrival  processes  are: 

Ai  =  .2;  A2  =  .3:  A3  =  .1;  Ai^  =  .4;  Ap3  =  .5;  A2,3  =  -6;  Ai^.3  =  -6 

The  following  procedure  is  Algorithm  1  applied  to  the  above  system. 

First,  let  us  break  arrival  process  Ai,2,3  into  two  pieces,  say  {1,2}  and  {3}.  We  see 
that  4/1,2  =  pi  +  p2  —  Ai  —  A2  —  A12  =  1.1.  Similarly,  4>3  =  //3  —  A3  =  .9.  Because 
Ai,2,3  =  -6  <  \&3,  we  can  set  P3’2’3  =  1,  giving  us  the  following  new  set  of  arrival  rates: 

Ai  =  .2;  A2  =  .3:  A3  =  .1  +  .6  =  .7;  Ai^  =  .4:  Ai^  =  .5;  A2,3  =  -6:  Ai,2,3  =  0 
Now,  let  us  split  arrival  process  A2,s-  We  see  that  T2  =  .7  and  \k3  =  .3.  Because 

9  2  3  5 

A2,3  =  -6  <  \l/  ,  we  can  set  p2  =  1,  giving  us  the  following  new  set  of  arrival  rates: 

Ai  =  -2;  A2  =  .3  +  .6  =  .9:  A3  =  .7:  Aii2  =  .4;  Aii3  =  .5;  A2,3  =  0;  Aii2,3  =  0 

Now,  let  us  split  arrival  process  Aii2.  AVe  see  that  T1  =  .8  and  tk2  =  .1.  Because 
1  12  5 

Aiy  =  .4  <  \k  ,  we  can  set  p{  =  1,  giving  us  the  following  new  set  of  arrival  rates: 

The  stability  constraints  on  b  and  d  are  that  b  <  T K  V K  such  that  B  C  K ,  D  (£_  K,  and  that  d  < 

MK  such  that  D  C  I\,  B  £  K. 


Ai  —  .2  +  .4  —  .6;  A2  —  .9;  A3  —  .7;  Ai,2  —  0;  Ai,3  —  .5;  A2,3  —  0;  Ag2,3  —  0 

Now,  we  split  arrival  process  Ai)3.  We  see  that  T1  =  .4  and  T3  =  .3.  A 1  .3  =  .5  is 
therefore  too  large  to  send  to  either  server  exclusively,  so  let  us  set  p}’3  =  |  and  P3’3  =  |, 
giving  us  the  following  set  of  arrival  rates: 

Ai  =  .6  +  .3  =  .9;  A2  =  .9;  A3  =  .7  +  .2  =  .9;  Air2  =  0;  A  1.3  =  0;  A2,3  =  0;  A 1  _ 2 T3  =  0 
Thus  we  have  determined  a  stabilizing,  open  loop  policy. 

It  is  interesting  to  point  out  that,  since  Theorem  1  ensures  that  the  recursive  algorithm 
for  determining  a  set  of  stabilizing  Bernoulli  splitting  probabilities  will  work  when  the 
system  is  stabilizable,  one  can  just  apply  the  algorithm  in  order  to  determine  whether  the 
system  is  stabilizable.  The  system  is  stabilizable  iff  the  algorithm  terminates  successfully. 


Section  3:  Open  loop  stability  of  the  controlled  service  process  problem  with 
a  single  class  of  packets 

In  addition  to  assuming  there  is  a  single  class  of  packets,  we  make  the  assumption 
that  service  time  depends  only  on  the  server,  i.e. ,  it  is  independent  of  the  queue  served. 
The  controlled  service  process  problem  under  these  assumptions  can  be  shown  to  be 
equivalent  to  a  system  first  introduced  in  discrete  time  by  Tassiulas  and  Ephremides  [1]. 
The  continuous-time  framework  we  use  here  is  equivalent  to  their  discrete-time  framework 
by  uniformization  [5].  In  [1],  Tassiulas  and  Ephremides  found  necessary  and  sufficient 
conditions  for  the  system  to  be  stabilizable  under  the  assumptions  of  this  section.  In 
the  proof  of  Theorem  2,  we  use  the  same  techniques  used  in  the  proof  of  Theorem  1  to 
explicitly  determine  an  open  loop  stabilizing  policy  when  a  stabilizing  policy  exists. 

Theorem  2 

The  queueing  system  of  the  ‘controlled  service  process  problem’  with  one  class  of  packets 
and  service  time  independent  of  queue  served  is  stabilizable  iff  (1.1)  holds. 

Furthermore,  if  the  system  is  stabilizable,  then  there  exists  an  open  loop  stabilizing 
policy  which  can  be  computed  explicitly  through  the  recursive  procedure  specified  in 
Algorithm  2. 

Proof:  see  Appendix  2 

Theorem  2  is  a  special  case  of  Theorem  2a,  which  is  proved  in  the  appendix.  Theorem 
2a  considers  a  discrete  time  system,  but  the  system  in  Theorem  2a  can  be  transformed 
through  uniformization  [5]  into  a  continuous  time  system.  The  system  of  Theorem  2a 
allows  servers  to  serve  an  arbitrary  subset  of  the  set  of  all  queues.  Thus,  we  see  that  the 
restriction  in  Theorem  2,  which  requires  each  server  to  serve  only  queues  that  contain  its 


index,  is  less  general  than  Theorem  2a.  Algorithm  2  will  determine  a  stabilizing  open 
loop  Bernoulli  service  policy  for  the  controlled  service  process  problem  iff  the  system  is 
stabilizable. 


In  recursively  reducing  the  arrival  rates  in  Algorithm  1,  there  was  no  need  to  use 
artificial  representations  because  each  subset  of  servers  had  its  own  arrival  process,  so  as 
arrival  processes  were  split,  they  decomposed  into  other  arrival  processes.  In  Algorithm  2, 
the  situation  is  different.  There  are  only  n  servers,  but  there  are  2n  —  1  possible  subsets  of 
queues.  As  these  service  sets  are  decomposed,  we  pass  through  artificial  subsets  of  queues 
on  the  way  down  to  the  actual  Bernoulli  splitting  probability  to  a  single  queue.  Therefore, 
new  notation  is  required  before  the  presentation  of  Algorithm  2.  Note:  Theorem  2a, 
proved  in  Appendix  2,  is  more  general  in  that  it  permits  a  server  to  be  dedicated  to  any 
subset  of  queues. 

Notation:  In  the  following  discussion,  capital  English  letters  denote  subsets  of  {1,  2, ...,  n} 
and  capital  Greek  letters  denote  sets  of  subsets  of  {1,  2, ...,  n),  with  the  exception  that  B 
and  D  also  denote  sets  of  subsets  of  {1,  2, ...,  n). 

Let  us  rewrite  the  Bernoulli  splitting  probability  pf  as  P{K\ieKy  Here,  we  use  p©,  where 
L  C  {1,2,...,  n}  and  0  C  {K\K  C  {1,  2, ...,  n}}  to  represent  the  Bernoulli  probability  that 
a  server  capable  of  serving  any  queue  in  the  set  {qx\K  £  0}  will  serve  queue  qL.  Let  us 
extend  this  further  by  using  the  notation  p|,  where  0,f  C  {K\K  C  {1,  2, ...,  ?r}},  <E>  C  0, 
to  represent  the  Bernoulli  probability  that  a  server  capable  of  serving  any  queue  in  the 
set  {qk\K  £  0}  will  serve  a  queue  selected  from  the  set  {(]k\K  £  <L}.  Also,  instead  of 
the  service  rate  of  server  Si:  let  us  write  P{K\ieK}-  In  general,  p,©,  where  0  C  { K \ K  c 
{1,  2, ...,  n}},  will  be  used  to  represent  the  service  rate  of  the  server  capable  of  serving  any 
queue  qx\K  £  0.  These  changes  in  notation  for  the  Bernoulli  splitting  probability  and 
the  service  rate  create  a  natural  representation  for  use  in  describing  Algorithm  2. 

The  set  { K \ t  £  K}  has  cardinality  2n_1,  and  before  the  Bernoulli  splitting  probabilities 
of  each  server  are  determined,  we  have  only  that  =  1  Vz  £  {1,  2, ...,  nj.  Our 

objective  is  to  reduce  these  down  to  the  or  in  the  original  notation,  the  pf  s. 

Algorithm  2 

GIVEN:  The  arrival  rates  {\l\L  C  { 1, ....  />} }  and  the  service  rates  {p{K\ieK}\i  G 

I1  ,•••,«}} 

CONSTRUCT:  a  stabilizing  set  of  Bernoulli  splitting  probabilities  {pfK\ieKy\i  £  L  C 
{'•  ••••"}} 

Do(j=2n_1,2n_1  -  1,...2) 

V  0  C  {K\K  C  {1,2,...,  n}}  such  that  |0|  =  j 
if  p@  >  0,  then 

Select  B,D  C  0  such  that  B  n  D  =  0  and  B  U  D  =  Q 


Select  two  numbers1  b  and  d  such  that  b  +  cl  =  //e  and  the  system  with  the  following- 
modified  service  rates  is  still  stable: 


/ye  =  0;  fig  is  increased  by  b;  //,/;  is  increased  by  d;  all  other  service  rates  unchanged. 


Then  set 

Solve  for  each  pfK\ieKy  by  multiplying  the  appropriate  chain  of  intermediate  splitting- 
probabilities  together. 


Example  2 

The  controlled  service  process  problem  takes  a  long  time  to  break  down  because  in¬ 
termediate  sets  of  queues  have  to  be  stepped  through,  so  an  example  with  three  servers 
would  be  tedious.  Let  us  examine  a  problem  with  two  servers  with  service  rates  /q  =  3 
and  yU2  =  2.  Let  the  arrival  rates  to  the  three  queues  be  given  by  Ai  =  1,  A2  =  1,  and 

A{i,2}  =  2. 

Following  Algorithm  2,  we  start  out  with: 

=  3:  P{{2} ,{i,2} }  =  2 

Now  let  us  split  service  process  A4{i},{i,2}}  into  two  pieces:  ppm}  and  //{{i,2}}  -  This 
split  will  not  affect  the  values  of  xl/iLhi1’2}},  or  xl/ll1}’!1’2}’!2}}^  but  it  will  affect  the 

values  of  the  other  fi/s.  Their  current  values  are: 

=  /^{{i},{i,2}}  -  Ai  =  2 

'J-T1’2)}  =  q{{1}i{1,2}}  +  ^{{2},{i,2}}  -  A{i,2}  =  3 

\j/{l}’{2}}  =  ^{{1}i{li2}}  +  -  A{1}  -  A{2}  =  3 

=  ^{{1}i{li2}}  +  //{{2},{1,2}}  -  A{1,2}  -  A{2}  =  2 

Splitting  ^{{i},{i,2}}  will  decrement  the  value  of  T^1}}  by  ^{{i,2}},  will  decrement  the 
value  of  \|>f f x’2f f  by  /U{{i}},  will  decrement  the  value  of  fl/A-Ti2}}  by  ^{{i,2}},  and  will  decre¬ 
ment  the  value  of  \|/f f x’2f  A 2f}  by 

Therefore,  we  are  constrained  that  //{{i,2}}  +  P{{i}}  =  3,  <  2,  and  P{{ip}}  <  2. 

We  choose  =  1-5  and  P{{ip}}  =  1.5,  giving  us  splitting  probabilities  of  pjjjj  ^  2jj  = 
and  2||  =  y|,  and  service  rates  of: 

AT{1}}  =  L5;  ^{{1,2}}  =  1-5;  AT{2},{1,2}}  =  2 

Now  let  us  split  service  process  /i{{2},{i,2}}  into  two  pieces:  P{{2}}  and  an  increment  to 

1The  constraints  on  b  and  d  are  given  in  terms  of  'F1' .  $  C  {K\K  C  {1, 2, ...,  n}},  defined  as  follows 
(Note:  this  is  different  from  the  definition  of  't,A  for  the  controlled  arrival  process  problem.): 

=  51  lnv  ~  5Z  Arc  (3-1) 

nc{A'|A'C{l,2,...,n}}|fin$^0  ag$ 

<F1’  is  the  “slack”  available  between  service  and  arrival  rates  for  subset  <F  i.e.  between  the  servers  with 
service  rates  ///,-:  K  C  <F  and  the  arrival  processes  with  rates  A  a;  K  €  $. 

The  stability  constraints  on  b  and  d  are  that  <FI>  >  b  V$  such  that  $  fl  B/l  and  $  fl  D  =  0,  and  that 
H/*  >  d  such  that  $  fl  D  ^  0  and  $  fl  5=0. 


^{{1,2}}*.  This  split  will  not  affect  the  values  of  TTRQ  xi/lDM1.2}}^  or  xl/lFhF^bD}^  but  it 
will  affect  the  values  of  the  other  Ts.  Their  current  values  are: 

Vp{{2}}  =  -  A2  =  1 

'J,{{1’2}}  =  ^{{1,2}}  +  ^{{2},{1,2}}  -  A{1,2}  =  1.5 
\J){1}’{2}}  =  {1,2}}  -  A{1}  -  A{2}  =  1.5 

Vj/{{l’2}i{l}}  =  M{{1}}  +  ^{{li2}}  +  ^{{2},{1,2}}  -  A{1,2}  -  Am  =  2 

Splitting  /i{{2},{i,2}}  will  decrement  the  value  of  vj/ll2)}  by  the  increment  to  £<{{1,2}}, 
will  decrement  the  value  of  tl/Th2}}  by  fi{{2}},  will  decrement  the  value  of  TATd2)}  by  the 
increment  to  tl{{i,2}},  and  will  decrement  the  value  of  \|/K1’2}41}}  by  ^{{2}} ■ 

Therefore,  we  are  constrained  that  h{{2}}  +  the  increment  to  P{{i,2}}  =  2,  ^{{2}}  <  1.5, 
and  the  increment  to  //{{i,2}}  <  1- 

We  choose  ATI2}}  =  1-25  and  the  increment  to  ^{{1,2}}  =  -75,  giving  us  splitting  proba¬ 
bilities  of  {x  2}}  =  and  2}}  =  “fS  and  service  rates  of: 

AT{i}}  =  !-5;  ^{{1,2}}  =  2.25;  p,{{ 2}}  =  1-25. 

And  we  have  found  a  stabilizing  open  loop  control. 

Conclusion 

We  have  shown  closed-form  algorithms  to  quickly  solve  for  an  open  loop  control  given 
that  the  system  is  stabilizable.  Furthermore,  each  algorithm  can  be  applied  as  a  check 
on  stabilizability.  If  the  algorithm  terminates  successfully,  the  system  is  stabilizable.  If 
it  doesn’t  terminate  successfully,  the  system  is  not  stabilizable.  The  two  main  results 
proved  in  Theorems  1  and  2  display  an  interesting  duality,  best  seen  by  comparing  (2.1) 
and  (3.1). 
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Note  on  the  appendixes: 

In  the  proofs  of  Theorems  1  and  2,  the  dimensionality  of  the  system  is  reduced  until  it 
is  1,  and  then  a  trivial  solution  to  the  linear  program  exists. 


Appendix  1:  Proof  of  Theorem  1 


Before  proceeding  with  a.  proof,  recall  the  definition  of  the  slack  variable  ’[' /'  given  by 

(2.1): 


**  =  E  ft“  E  V 

s,esK  ALeAK 

The  theorem  assumes  that  the  slack  for  each  K  C  {l,...,n}  is  strictly  greater  than 
zero. 

We  will  be  using  sets  of  the  form  where  IT,  V  C  {1 . n};  W  ^  0.  Cm  is  defined 

by 


c  =  {it  C  n}|l/c  K,W<£  K} 


Also,  define  £0  by 

=  {K  C  {1,  ..rin}\V  C  K} 

For  example,  if  n  =  3,  then  £§}  =  {{1},  {1,  2}};  C0{1’2}  =  {{1,  2},  {1,  2,  3}}. 
We  will  be  interested  in  the  slack  quantity  'Id,  .  where 


$ 


v  _ 

W  — 


min 

K’c 


Note  that  'Id,  is  strictly  greater  than  zero  since  the  minimum  over  a  finite  set  is 
achieved. 

Recall  that  there  is  only  one  class  of  packets  for  Theorem  1,  so  the  superscript  j  is 
dropped  from  all  notation,  e.g.  X'K  =  XK. 

Two  lemmas  will  be  required  in  the  proof  of  Theorem  1: 


Lemma  1.1 

Given  D,  B  C  {1, ...,  n}, 


Proof: 


Yl  dif  -  Yl  d,v  +  Yl  d/y  | 

AKeADUB  AKeAD  AKeAB 

Yl  d/y  -  Yl  d  f\ 

AKe[ADUB-AD -AB]  AKeADnB 

ADUB  =  AduAb[J  ^adub  _ad_  ab | 
ad  n  ^dub  _ad_  ab ]  =iBn  {Adub  _  ad  _  ab^  =  0 


AD  n  AB  =  { ak\k  c  d}  n  {Ak\k  c  b}  =  {Ak\i<  cDn5} 

The  result  follows. 

Lemma  1.2 

Given  D,  B  C  {1, // }.  G  C  DU  D,  G  (jt.  D,  G  (jL  J3,  and  the  assumptions  of  Theorem  1, 
we  have 


>  AG- 


Proof: 

We  know  that 


^UB=  E  E  a* 

s,esdub  akeadub 

Let  us  examine  the  first  and  second  terms  of  the  right  side  of  the  above  equation.  For 
the  first  term  we  have: 


El  Ah  —  El  Ah  T  El  Ah  El  Ah 

.S’iC.s'"  '•«  5;e.SD  S/GS8  S/GS808 


The  second  term  (the  subtracted  term)  is: 


£  a*- 

akeadub 


which,  by  lemma  1.1  equals 


£  A„-  +  £  A/1  +  £  A,,--  £  A// 

Ak£Ad  AkeAb  Ake[Adub-Ad -Ab\  AKEADnB 


Using  the  definition  of  T  ' ,  we  have 

\^DUB  _  tyD  _j_  _  tyBnB 


E  < 

AkE[Adub-Ad-Ab] 


X$D  +  yB  _  \K  < 

AkE[Adijb-Ad-Ab] 


+  ^B  _  Xg 


Using  the  fact  that  T DUB  >  0,  we  have  the  result. 


Proof  (Theorem  1): 

For  every  K  C  {l,...,n},  we  will  use  Bernoulli  splitting  of  the  arrival  process  AK, 
so  that  when  an  arrival  from  the  process  A  K  occurs,  it  will  be  routed  to  queue  q*  with 
probability  p'K ,  where  =  0  for  i  K.  and  K  plK  =  1.  For  W  C  K ,  define 
I>)1  =  Y.iewPK ■  Therefore,  we  have  p%  =  1. 

We  now  define  a  method  to  construct  {plK  }  for  each  arrival  process  AK.  For  K  =  {A:}, 
we  have  pkK  =  1  and  we  are  done  (Note  that  ,4p.}  is  an  uncontrolled  arrival  process  -  it 
is  routed  to  qpk})-  Suppose  that  \K\  =  l  >  1.  Let  Jv  =  {rq , ....  rq}.  We  now  define  a 
recursive  method  to  determine  p“K :  1  <  t  <  l. 

We  know  that  3B,  D  /  0  such  that  it  =  DUB  and  DPB  =  0.  Also,  we  know  that  the 
minimum  which  defines  is  achieved.  Let  us  say  that  U  C  (B  achieves  the  minimum. 
We  also  know  that  3V  C  Co  which  achieves  the  minimum  in  From  lemma  1.2  we 
have  that  +  T 1  >  XK.  Therefore, 

^d  +  ^b> 

Therefore,  36,  d  >  0  such  that  b  +  d  =  XK  and 

6  < 

We  claim  that  if  XB  is  increased  by  6,  XD  is  increased  by  d.  and  XK  is  set  to  zero,  the 
equation 


/  Pi  >  Z—i  . «! 

still  holds  MW  C  { 1 ,  ....// }. 

Proof  of  claim:  Examination  of  the  above  equation  (which  is  equivalent  to  the  condition 
\!/T1  >  OVIF  C  {1, ...,  n}),  reveals  that  only  the  value  of 


22 

Aai,..„a,eAW;l<l<\W\ 

is  affected  by  the  change  and  that  it  is  only  affected  for  W  G  [C,B  U  (B].  (The  value 
is  unaffected  for  W  G  since  6  and  d  are  subtracted,  but  A k  is  added  to  \P ! '  ,  and  it  is 
totally  unaffected  for  W  G  [£#  D  £f)] )  Recall  that  6  and  d  were  chosen  so  that 

6  <  V“:d  < 

Therefore,  the  value  of  T "  is  reduced,  but  still  greater  than  zero  for  W  G  U  Cf  • 

Since 


{»'  c  {l, =  [cl  u  (%]  u  (f  u  [cl  n  cl] 


The  claim  is  proved. 


We  have  just  seen  that  if  the  AK  is  Bernoulli  split  by  defining  pf-  =  and  p1/  = 
and  if  an  AK  arrival  split  to  B  (respectively  D )  is  treated  exactly  like  an  AB  arrival 
(respectively  an  AD  arrival),  then  the  It's  are  all  still  strictly  greater  than  zero. 

Let  us  begin  with  the  system  given  in  the  assumption  of  theorem  1.  First,  we  Bernoulli 
split  the  ^4{i,...,n}  arrival  process  into  two  pieces,  and  record  what  the  two  subsets  and 
their  Bernoulli  probabilities  are.  We  now  have  a  new  system  satisfying  the  assumption  of 
theorem  1.  Next,  split  each  of  the  arrival  processes  .4  K .  where  \K\  =  n  —  1.  Record  their 
Bernoulli  splitting  probabilities  as  well  as  the  subsets  they  were  split  into  and  update  the 
values  of  the  As  accordingly.  Then  split  each  of  the  arrival  processes  with  \K\  =  n  —  2. 
Proceed  until  all  of  the  controlled  arrival  processes  have  zero  arrival  rate.  By  construction, 
it  holds  that 

A,;  <  //,V/  G  { 1 . //} 

so  the  resulting  system  of  M/M/1  queues  is  trivially  stable.  The  Bernoulli  splitting 
probability  p'K  can  be  found  by  taking  the  Bernoulli  probability  of  the  subset  containing  i 
that  K  was  split  into,  multiplying  it  by  the  splitting  probability  of  the  subsequent  subset 
that  contains  i  which  that  subset  was  split  into,  and  proceeding  until  you  are  split  into 
{/'}  itself. 

We  have  specified  a  method  to  construct  (given  the  As  and  the  //,s)  an  open  loop 
Bernoulli  splitting  routing  policy  which  stabilizes  the  “controlled  arrival  process”  routing- 
problem. 


Appendix  2:  Proof  of  Theorem  2 

Rather  than  prove  Theorem  2  as  stated,  we  prove  a  version  in  discrete  time  stated 
as  Theorem  2a.  Before  stating  Theorem  2a,  we  introduce  the  discrete  time  controlled 
service  process  system  with  a  single  server  which  may  serve  any  one  of  a  randomly  selected 
subset  of  the  queues  at  each  time  instant.  It  can  be  shown  through  uniformization  [5] 
that  the  Theorem  2a  is  equivalent  to  Theorem  2.  Thus,  not  only  is  a  discrete-time 
system  equivalent  to  the  continuous  time  system  of  Theorem  2,  but  the  discrete  time 
system  has  a  single  server  with  random,  time-varying  connectivity  rather  than  multiple 
servers.  The  discrete  time  controlled  service  process  system  is  equivalent  to  a  single-server 
system  introduced  by  Tassiulas  and  Ephremides  [1].  It  is  important  to  note  that  while 
the  controlled  service  process  problem  can  be  reduced  to  the  case  of  a  single  server,  the 
controlled  arrival  process  problem  cannot,  even  through  uniformization. 

The  system  which  Tassiulas  and  Ephremides  address  in  [1]  is  a  discrete-time  system 
with  a  single  server  and  n  queues.  At  each  time  instant,  there  are  A\  arrivals  at  queue  q* 
where  E[Aj\  =  cp ,  and  Aj  is  bounded  \/t.  The  number  of  arrivals  to  queue  %  at  time  t.\  is 
independent  of  and  identically  distributed  to  the  number  of  arrivals  to  queue  g,  at  time 
i-2-  At  each  time  t,  a  subset  Wt  C  {  I. ....  //}  of  the  queues  is  connected  to  the  server.  Wt 
is  distributed  as  follows: 


P[Wt  =  K]  =  PfK,  I\  C  {1, ...,  n} 


Tassiulas  and  Ephremides  define  a  connectivity  variable  Cj  such  that  Cj  =  1  if  i  G  Wt 
and  Cj  =  0  otherwise.  They  require  that  Cj1  and  Cj2  are  independent  and  identically 
distributed.  This  is  ensured  by  the  stronger  requirement  that  n  =  pK  Vt.  However,  in 
their  remark  4  (p.  472),  they  generalize  their  result  to  the  case  of  dependent  connectivity 
variables  at  time  t  (Their  derivation  assumed  the  independence  of  Cj  and  Cj\  i  ^  j.) 
Therefore,  this  stronger  requirement  is  appropriate  and  parsimonious.  At  each  time  t, 
the  server  decides  which  connected  queue  to  serve  based  on  the  current  queue  lengths, 
the  history  of  the  queue  lengths  and  the  history  of  past  decisions.  If  queue  %  is  chosen 
for  service  at  time  t,  the  service  is  completed  successfully  if  the  random  variable  Mj  =  1, 
and  it  is  unsuccessful  if  Mj  =  0.  It  is  also  required  that  Mj1  and  Mj2  are  independent 
and  identically  distributed,  and  the  expected  value  of  M,  is  denoted  by  m, .  Finally,  the 
arrival,  connectivity,  and  service  completion  random  variables  are  independent. 

In  [1],  it  was  determined  that  the  system  is  stabilizable  iff 

E—  <  E  /u:V/xc  {1 . 

i£K  WeSK 

(see  their  eqn  3.2,  p.  468  and  remark  4,  p.  472) 
where  SK  is  defined  by 


SK  =  {W  C  {1 . //}  U' A/\  /  0} 

Remark:  SK  refers  to  a  set  of  subsets  of  the  n  queues  which  may  be  connected  to  the 
server  at  a  particular  time. 

We  can  now  state  Theorem  2a: 

Theorem  2a 

The  discrete  time  controlled  service  process  problem  is  stabilizable  iff 

£— <  z  Pw-yK  c{l,...,n} 

/'•  k  n>l  wesK 

Furthermore,  if  the  system  is  stabilizable,  then  there  exists  an  open  loop  stabilizing 
policy  that  can  be  determined  directly  through  a  recursive  algorithm  analogous  to  Algo¬ 
rithm  2. 

Before  we  proceed  to  the  proof,  we  need  to  introduce  some  notation  and  prove  two 
lemmas.  First,  a  brief  explanation: 

Similarly  to  the  proof  of  Theorem  1,  we  shall  construct  a  stabilizing  policy  using 
Bernoulli  splitting.  Instead  of  splitting  at  the  arrival  process  AK,  we  now  split  at  the 
service  process  Wt.  For  each  K  G  {1, ....  // }.  we  decide  on  the  probabilities  p'K  of  serving- 
queue  Qi  given  that  the  set  of  connected  queues  at  time  t  is  ITt  =  K . 

Similarly  to  Theorem  1,  we  introduce  some  notation.  Define  the  “slack”  available 
between  the  connectivity  rate  and  arrival  of  work  rate  for  subset  K  by 


*A'=  E  iV-E  — >o 

—  —  777  • 

U  •  .s'*  it  K  ' 

Remark:  The  above  definition  is  the  same  as  (3.1),  where  now  we  use  P\y  in  place  of  jiw 
and  -2L  in  place  of  X-,. 

Lemma  2.1 

Given  D,  B  C  {1, n}, 

E  ^  =  E  pk  +  E  pk  ~  E  ^  -  E  pk 

kesdub  KesD  KesB  KesDnB  Ke[(sDnsB)-sDnB] 

Proof: 

SDUB  =  {K  C  {1, ....  n}\K  n  {D  U  B}  ±  0}  = 

{K  C  { 1 . ....  /?}  {A"'  /l}U{/\  /i}  /  0}  = 

{K  C  {1, ...,  n}|AT  n  D  ±  0}  U  {A  C  {1, ...,  n}|K  flB/0}  = 

Also, 

5fln5B  =  u  [(SD n 5s)  -  SDnB] 

and 

SDnD  n  [( SD  n  SB )  -  SDnB ]  =  0 

The  result  follows. 

Lemma  2.2 

Given  D,B,G  C  {1, ...,  n},  such  that  G  fl  /  0,  Gnfi  /  0,  Gflfiflfi  =  1  and  given 
that  the  assumptions  of  Theorem  2  hold,  we  have 

>  PG 

Proof: 

We  know  that 


*"UB=  E  Pk-  E  f1 

i<esDUB 


By  lemma  2.1,  the  first  term  on  the  right  side  of  the  above  equation  can  be  written  as 

£  Pk=  £  iV+  £  p*-  £  p*  -  £  Pk 

kesdub  k  s'l  KesB  KesDnB  Ke[(sDnsB)-sDnB] 

The  second  (subtracted)  term  can  be  written  as 

M'i  _  Q>i  Q>i  Q>i 

iesDUB  ;  .S'"  m*  m*  j^s^ns 


So,  by  the  definition  of  T K .  we  can  write 

\$)DyjB  =  \&D  +  \|/B  -  v]/1305 

So  we  have  that 

0  <  tyDUB  +  tyDnB  =  \ffD  tyB  — 


E  Pk 

Ke[(sDnsB)-sDnBi 


£  Pk  < 

A’e[(.5Dn,s-B)-,sDns] 


-  P( 


G 


We  now  introduce  more  new  notation.  Please  note  that  \f,A,  (B,  and  '&B  are  defined 
differently  here  than  they  were  in  the  proof  of  Theorem  1. 

Define  Eb  as 


Cs  =  {K  C  {1, n}\D  nif/0,BflA'  =  0} 
Furthermore,  define  as 

C|  =  {Pc{i,...,n}|Pnw  =  0} 


And  define  as 


$ 


D 

B 


min  'f,A 

K^E 


We  are  now  ready  to  proceed  with  the  proof  of  Theorem  2. 


Proof: 


We  now  describe  how  to  split  Pq  into  two  pieces  so  that  the  assumptions  of  Theorem 
2a  still  hold.  The  rest  of  the  proof  (i.e.  constructing  the  branching  leading  down  to  the 
individual  Pp}S,  and  defining  the  Bernoulli  splitting  probabilities  as  the  product  of  the 
splitting  probabilities  going  down  the  branching)  is  identical  to  the  proof  of  Theorem  1, 
and  is  not  repeated  here. 

Let  G  C  {1, ...,  n},  |G|  >  2.  Then  3B,  D  C  {1, ....  n}  such  that  P,  D  ^  0,  B  n  D  =  0, 
and  B  U 1)  =  G.  Let  U  C  {1,  ...,  n}  achieve  the  minimum  over  K  G  in  Also,  let  V 
achieve  the  minimum  over  K  G  in  vJ/£.  We  know  by  lemma  2.2  that  d-d  -f  >  p(, . 
Choose  b.  cl  >  0  such  that  b  <  T 1  =  T g .  d  <  T 1  =  and  b  +  d  =  PG.  We  claim  that 
if  Pq  is  set  to  zero,  Pb  is  increased  by  6,  and  Pd  is  increased  by  d.  then  the  assumptions 
of  Theorem  2  still  hold. 

Proof  of  claim: 

We  must  verify  that  we  still  have  that  'I' A  >  0,  MK  C  {1, ...,  n}.  If  A'  G  Cbud^  then  PG, 
Pb,  and  PD  have  no  effect  on  the  value  of  T h .  so  it  is  still  greater  than  zero.  Similarly, 
if  K  G  [($  fl  £(f],  then  the  value  of  remains  unchanged  because  b  and  d  are  added  to 
it,  while  PG  is  subtracted  from  it.  If  K  G  then  PG  is  subtracted  from  while  b  is 
added  to  it.  So  in  effect,  d  is  subtracted  from  it.  But  d  <  n  <  xl>K ,  so  fid'  is  still  larger 
than  zero.  By  an  analogous  argument  (switch  the  bs  and  r/s ) .  if  I\  G  £b  ,  then  d/A,  while 
reduced  is  still  greater  than  zero.  Since 

{dt  C  n } }  =  Cb  U  (d  U  C bud  U  [($  C 


the  claim  is  proved. 

If  we  reduce  down  to  the  Pp}S  as  in  the  proof  of  Theorem  1,  then  we  have  by  construc¬ 
tion  that 


—  <^}v?;g  {l,...,n} 

Wi 

Since  we  know  that 

J?[x'+1  -  x']  =  E[A<  -  M<P\, ,]  = 

E[A‘]  -  E[M>]E[P'ti}]  =  <k  -  mP{i)  <  0 

and  we  know  that  the  Markov  chain  defined  under  this  Bernoulli  splitting  policy  is 
irreducible  and  that  x*+1  —  x\  is  bounded  since  A\  is  bounded,  we  have  by  Foster’s  theorem 
on  ergodicity  of  a  Markov  chain  ( [6] )  that  the  system  is  stable. 


